Incremental Markov-Model Planning
نویسنده
چکیده
This paper presents an approach to building plans using partially observable Markov decision processes. The approach begins with a base solution that assumes full observability. The partially observable solution is incrementally constructed by considering increasing amounts of information from observations. The base solution directs the expansion of the plan by providing an evaluation function for the search fringe. We show that incremental observation moves from the base solution towards the complete solution, allowing the planner to model the uncertainty about action outcomes and observations that are present in real domains.
منابع مشابه
BI-POMDP: Bounded, Incremental, Partially-Observable Markov-Model Planning
Given the problem of planning actions for situations with uncertainty about the action outcomes, Markov models can eeectively model this uncertainty and ooer optimal actions. When the information about the world state is itself uncertain, partially observable Markov models are an appropriate extension to the basic Markov model. However , nding optimal actions for partially observable Markov mod...
متن کاملLand use and land cover spatiotemporal dynamic pattern and predicting changes using integrated CA-Markov model
Analyzing the process of land use and cover changes during long periods of time and predicting the future changes is highly important and useful for the land use managers. In this study, the land use maps in the Ardabil plain in north-west part of Iran for four periods (1989, 1998, 2009 and 2013) are extracted and analyzed through remote sensing technique, using the land-sat satellite images. T...
متن کاملAdaptive Planning for Markov Decision Processes with Uncertain Transition Models via Incremental Feature Dependency Discovery
Solving large scale sequential decision making problems without prior knowledge of the state transition model is a key problem in the planning literature. One approach to tackle this problem is to learn the state transition model online using limited observed measurements. We present an adaptive function approximator (incremental Feature Dependency Discovery (iFDD)) that grows the set of featur...
متن کاملPlanning in Models that Combine Memory with Predictive Representations of State
Models of dynamical systems based on predictive state representations (PSRs) use predictions of future observations as their representation of state. A main departure from traditional models such as partially observable Markov decision processes (POMDPs) is that the PSR-model state is composed entirely of observable quantities. PSRs have recently been extended to a class of models called memory...
متن کاملIncremental Clustering and Expansion for Faster Optimal Planning in Decentralized POMDPs
This article presents the state-of-the-art in optimal solution methods for decentralized partially observable Markov decision processes (Dec-POMDPs), which are general models for collaborative multiagent planning under uncertainty. Building off the generalized multiagent A* (GMAA*) algorithm, which reduces the problem to a tree of one-shot collaborative Bayesian games (CBGs), we describe severa...
متن کامل